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Abstract 

We introduce orderings <C;p- between total functions /. g : N ^ N 
which refine the pointwise "up to a constant" ordering <ct and also 
insure that f{x) is often much less than g{x). With such <C^^ 's, 
we prove a strong hierarchy theorem for Kolmogorov complexities ob- 
tained with jump oracles and/or Max or Min of partial recursive func- 
tions. 

We introduce a notion of second order conditional Kolmogorov com- 
plexity which yields a uniform bound for the "up to a constant" com- 
parisons involved in the hierarchy theorem. 



1 Introduction 

1.1 Comparing total functions N — M 

Notation 1.1. Equality, inequality and strict inequality up to a constant 
between total functions / — > N, where I is any set, are denoted as follows: 

f <ct 9 ^ 3c e N Vx G / /(x) < gix) + c 

/ =ct 5 ^ / <ct 5 A 5 <ct / 

^ 3c G N Vx G / |/(x) -5(x)| < c 

/ <ct 9 <^ / <ct 5 A -^{g <ct /) 

^ / <ct 5 A Vc G N 3x G I g{x) > f{x) + c 

Total functions /, g : N — > N can be compared in diverse ways. The sim- 
plest one is pointwise comparison via the partial ordering relation Vx f{x) < 
g{x). In case functions are considered up to an additive constant, for in- 
stance with Kolmogorov complexity, pointwise comparison has to be re- 
placed by the <ct preordering or the <ct ordering. 
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Observe that the <ct ordering is an infinite intersection: 

/ <ct 5 / <ct 5 A Vc G N / <io 5 - c 

where <io (io stands for "infinitely often") is the non transitive relation 

f <io g {x : fix) < g{x)} is infinite 
Relation <jo can be much refined via localization: instead of merely de- 
manding {x : f{x) < g{x)} to be infinite, one can ask it to have infinite 
intersection with every infinite set in a family C of sets. 
In case C is the family of all subsets of N, this gives the relation 

{x : f{x) < g{x)} is cofinite 
which is a partial ordering relation. 

In case C is the family of r.e. sets, this is related to the idea of coimmunity. 
An instance of such a relation appears in a classical result about Kolmogorov 
complexity K, due to Barzdins (cf. ^ Thm.2.7.1 iii, p. 167, or Zvonkin & 
Levin, [T7] p. 92.), which states that, for any total recursive function (p which 
tends to +oo, the set {x : K{x) < (f>{x)} meets every infinite r.e. set. 

In practice, for simple classes C, an infinite subset of X n{x : f{x) < g{x)}, 
for X infinite in C, can always be found in a not too complex class V. Which 
leads to consider the relation OftLess^''^ such that 

/ OftLess^'^ g ^ yX eC 3Y eV {X is infinite 

Y is infinite A T C {x : f{x) < g{x)}) 

li C = T> then this relation is transitive, hence is a strict partial ordering. 
However, in case C ^T>^ transitivity may fail (for instance, a counterexample 
is obtained via Lemma IS.lOj) . 

The key observation for the paper is as follows: 

For anyCj'D, the relation f <ct g A Vc (/ OftLess''''^ 9 — c) is transitive, 
hence is a partial strict ordering refining <ct- In other words, considering 
OftLess''''^ up to any constant and mixing it with <ct always leads to an 
ordering. 

If J'-" is a family of total functions N — > N which tend to +00 and is closed 
by translations (i.e. (p £ implies max(O,0 — c) € then the above 
observation also applies to the relation / <ct g A V(/> G J- f OftLess'"''^ <P°g, 
i.e. the relation 

/ <ct 5 A y^£j^yXeC3Y£V 

(X is infinite =^ y is infinite A Y {x : f{x) < g{x)}) 
which is also a partial strict ordering refining the ordering <ct. 

Enriching this relation with the requirement that a code for an infinite subset 
Y of X n {x : f{x) < cj}{g{x))} can be effectively computed from codes for 
(f> and X, we get the relation OftLessy which is the main concern of this 
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paper. 

In ^ we review some needed elements of oracular comput ability. This is 
done in terms of partial computable functionals so as to get uniformity in 
the oracle. 

In ^ we recall Xiang Li's notion of constructive immunity and introduce 
the related notions of (C, P)-density and constructive density. 

In ^ we introduce the relation OftLess^^ and its variant OftLess^| 
(where only total monotone increasing functions in are considered) and 
prove that their intersections ^^'^ and "C^^ with <ct are strict orderings 
refining the ordering <ct- 



1.2 Second order Kolmogorov complexity 

In relation with the partial computable functional approach to oracular com- 
putability (cf. we develop in f|5] a functional version IC{x \ \A) of Kol- 
mogorov complexity. This amounts to a simple, seemingly unnoticed, fact: 
Oracular Kolmogorov complexity K^ can he obtained by instantiating to A 
the second order parameter of a variant of conditional Kolmogorov complex- 
ity in which the condition is a set of integers rather than an integer. The 
oracle is thus viewed as a second order conditional parameter. 
The usual proof of the invariance theorem goes through. This second-order 
conditional complexity allows for a uniform choice of oracular Kolmogorov 
complexities (this is detailed in ^ since, for any A, 

lC{x\\A) =et K^{x) 

i.e. yA 3c Vx |i^^(x) - IC{x\\ A)\ < c. 

A typical benefit of the functional version of K is as follows. Usual proper- 
ties with K involving equality or inequality "up to a constant" go through 
oracles. Let ca be the involved constant for the oracle A version. For a 
single equality or inequality involving K^, it may be possible to modify K"^ 
(by an additive constant) so that ca = 0. But this is no more possible for 
several equalities or inequalities since the needed modifications of K"^ may 
- a priori - be incompatible. 

Thus, for a system of equalities or inequalities, there is no a priori A- 
computable bound of the involved constant ca for the oracle A version. 
However, in case (which is also usual) such properties also go through the 
functional version, the constant bound involved in the functional version is 
valid for any oracle. In other words, whereas the oracular version a priori 
allows no A-computable hound of the constant, the functional version does 
allow a constant bound. 

This fact is applied in ^8.6l to get sharper results. 
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In f|6] we recall the variants -^^max' -^min °^ Kolmogorov complexity intro- 
duced in our paper [5] and we extend them to functional versions. The pre- 
cise relation between such functional versions and the oracular i^uiax; ^min 
is detailed in ^ 

1.3 A strong hierarchy theorem for Kolmogorov complexi- 
ties 

In ^8.11 we prove of a version of Barzdins' result cited in ^1.11 (cf. also ^3.ip 
with as much effectivity as possible which involves an ordering relation in- 

troduced in ^ and can be stated as K <Cpp^ ^ log. Also, the functional 
versions of Kolmogorov complexity and the functional approach to oracular 
computability allow to get a functional version of this result, hence to get 
effectivity relative to the oracle. 

We extend this result in ^8.21 18.31 18.41 and prove that K, i^maxi -^min 
compared via the above OftLess and <C relations, with more complex 
classes 0,1), namely C = U II^ and V = 3^'^(S5 A II^) or the variants 
in which is constrained with a "recursively bounded growth" condition 
(cf. Def l8.7p . Also, the class can be extended to Miup^, i.e. the class of 
infima of partial recursive sequences of functions. 

The above class 2? is a subclass of which can be obtained via bounded 
existential quantification over boolean combinations of relations. In §8.5^ 
we show that such syntactical complexities naturally appear when compar- 
ing K,K^^^,K^.^. 

Finally, in y8.6l we prove the main application of the <cy and order- 
ings, which is a strong hierarchy theorem for the Kolmogorov complexities 
K, K^g^^, K ■ and their oracular versions using the successive jumps. 



2 Partial computable functionals and oracular re- 
cursion theory 

2.1 Notations 
Notation 2.1. 

1. [Basic sets] X,Y denote products of non empty finite families of spaces 
of the form N or Z or S* where S is some finite alphabet. 

2. [Partial recursive functions] Let A C N. We denote PR^^^ (resp. 
PR^'^^'^) the family of partial recursive (resp. ^-recursive) functions be- 
tween basic sets X and Y. 

3. [Bijections between basic spaces] For any basic spaces X, Y and Z we 
fix some particular total recursive bijection from X x Y to Z and denote 
{^,y)xxY Z' simply (x,y), the image in Z of the pair (x,y). 
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2.2 Some classical results from recursion theory 

We shall use the following classical results from computability theory (cf. 
Odifreddi's book dU p.372-374, 288-292, or Shoenfield's book [l5]). 

Proposition 2.2. 

1. (Post's Theorem, 1948 [13]) A set is ^n+i (^^sp. A^_|_-^J if and only if it 
is recursively enumerable (r.e.) (resp. recursive) in oracle 0^"\ 

2. (Post, 1944 p^) For any oracle A, every infinite A-r.e. set X contains 
an infinite set Y which is recursive in A. Moreover, one can recursively go 
from an r.e. code for X to r.e. codes for such a Y and its complement. 

In particular, every infinite ^^j^i set X contains an infinite ^^j^i subset Y . 
Also, one can recursively go from a Tj^j^^-code for X to Y^^j^^^-codes for such 
a Y and its complement. 

3. Recall that an A-r.e. set X d'H is maximal if it is coinfinite and for any 
A-r.e. set Y ^ X either N\Y is finite orY\X is finite. 

(Priedberg, 1958 [6J) There exists maximal A-r.e. sets. 

Remark 2.3. 

1. Since every 11^ set is '^n+i^ point 2 of the above proposition yields 
that every infinite 11^ set contains an infinite A^_|_^ subset. This cannot be 
improved: the complement of any maximal recursively enumerable set is an 
infinite II^ set which does not contain any infinite recursive set. 

2. Any total function ip with graph in is in fact 0^"~^)-recursive and has 
graph in since y 7^ tp{x) 3z ^ y z = tp(x). 

2.3 Partial computable functionals 

Defi231is classical, cf. Rogers [14J p.361, or Odifreddi plj p.l78. 

Definition 2.4. A (partial) functional : X x P(N) — > Y is partial com- 
putable if there exists an oracle Turing machine M such that, given A G 
P(N) as oracle and x G X as input, 

- M halts and accepts if and only if J^{A, x) is defined, 

- A4 halts and accepts then its output is J^{A,x). 

The family of partial computable functionals X x P(N) ^ Y is denoted 

The notion of acceptable enumeration of partial recursive functions (cf. 
Rogers [H] Ex. 2.10 p. 41, or Odifrreddi [11], p. 215) extends to functionals. 

Definition 2.5. We denote X, Y, Z some basic sets (cf. Notation 12. ip . 

1. An enumeration ($j)jgN of partial computable functionals X x P(N) — > Y 
is acceptable if 
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i. {i,x,A) 1-^ ^i{x,A) is a partial computable functional. 

ii. Every partial computable functional X x P(N) ^ Y is enumerated: 

iii. the parametrization (also called s-m-n) property holds: for every basic 
set Z, there exists a total recursive function : N x Z — > N such that 

Vi VzGZ VxGXVACN ^^{{z,x),A) = ^^^.^^^(x, A) 

where (z, x) is the image of the pair (z, x) by some fixed total recursive 
bijection Z x X ^ X (cf. Notation EI]) . 

2. An enumeration (yVi)igN of subsets of X x P(N) is acceptable if there 
exists an acceptable enumeration (<I>j)jgP(j of partial recursive functionals such 
that Wj is the domain of ^i. 

In particular, (Wj)j(=M subset of N X X X P(N). 

Proposition 2.6. There exists an acceptable enumeration of partial com- 
putable functionals X x P(N) Y. 

2.4 Uniform relativization 

When dealing with oracles A, it is often possible to get results involving 
recursive transfer functions rather than 74-recursive ones. To do so, we must 
consider enumerations of ^-r.e. sets and partial A-recursive functions which 
are obtained from enumerations of partial computable functionals by fixing 
the second order argument A. Such enumerations will be called uniform 
enumerations. 

This amounts to consider relative computability as a concept dependent 
on the prior notion of partial computable functional, though, historically, 
relative computability came first, cf. Hinman's book [7j 5.15 p. 68. 

Proposition 2.7. 

Let (<I>j)jgp^ be an acceptable enumeration of partial computable functionals 
X X P(N) ^ Y. 

For ^ C N, define (pf : X — > Y and C X from <I>j and Wi by fixing the 
second order argument as follows: 

ipf{x) = ^i{x,A) = domain{^f) = {x:(x,^)GWi} 

Then the sequences {ipf)i(zm and {Wf-)i^m are acceptable enumerations of 
the family PR^~*^'^) of partial A-recursive functions X ^ Y and that of 
A-r.e. subsets of\. 

Such acceptable enumerations are called uniform enumerations. 
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Rogers' theorem (cf. Odifreddi [TT] p. 219) extends to partial computable 
funtionals, hence to uniform enumerations. 

Theorem 2.8. 

1. (Rogers' theorem) If{^i)i(=fq and ($j)jgN ^'"e both acceptable enumer- 
ations of partial computable Junctionals X x P(N) Y , then there exists 
some recursive bijection : N ^ N such that = <I>g(j) for a// i € N. 

2. If {ifjf)i^-^ and {(pf)i^f>j are uniform enumerations of partial A-recursive 
functions then there exists some recursive bijection 6 : N —>■ N such that 

= ffii) for all i G N. 

Uniform enumerations allow for effective (as opposed to A-effective) clo- 
sure results for a lot of operations on partial ^-recursive functions and A-r.e. 
sets which correspond to closure properties of partial computable function- 
al admitting sets and partial functions as arguments, cf. Hinman [7J §11.2, 
II.4. 

2.5 Acceptable enumerations of some subclasses of 

Comparison of K and K^:^^ , i^max the hierarchy theorem 18.141 involves 
particular sets described in Def l2.12] below. First, we fix a notion of 
bounded quantification pertinent for our applications. 

Definition 2.9. 

1. We consider on each basic set a norm such that 

- I |x| I = |x| if x G N or Z, 

- ||x|| = length{x) if x € S* where S is a finite alphabet, 

- ||(a^i,---,a;fc)|| = max(||xi||, ||xi||). 

2. Suppose /X : N ^ N is a total function (resp. : N x P(N) ^ N is 
a total functional) which is monotone increasing (resp. with respect to its 
first argument). Let X is a basic set. 

For C X X ({0, 1}*)™ and 7^ C X X ({0, 1}*)" x P(N), we let 

B^^'R = {x:3u(|ui|,...,|u^| </i(||x||) A i?(u,x))} 
B^f^n = {(x,A) :3u(|ui|,...,|u„| </i(||x||) A 7^(u,x,A))} 

If C C P(X) (resp. C C P(X x P(N)), we denote B^^C the subclass of 
subsets of X (resp. X x -P(N)) consisting of all sets where R is in C. 

Note 2.10. In view of applications to Kolmogorov complexity, we choose 
bounded quantifications over binary words (where the bound applies to the 
length). Of course, going from fi to 2^, we can reduce to bounded quantifi- 
cations over N. 

As is well known, bounded quantification does not increase syntactical 
complexity of sets. 
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Proposition 2.11. ///i : N ^ N /las graph then B-Z^A^ C A^, be it for 

relations in X or in X x P(N). 

Proof. In case = x this is just the commutation of a bounded quantifi- 
cation with an unbounded one. In general, we have 

3u (u < /u(l|xl|) A -R(x,u)) 

O 3yiy = fi{\\x\\) A 3u (u < y A -R(x,u))) 
^ yy{y = n{\\x\\) =^ 3u(u<y A i?(x,u))) 

which are respectively 3 (S^ AA^), hence S^, and V (11^ VA§), hence 11^. □ 

Definition 2.12. 

Let C be a syntactical class among 

1. Let C[X] be the family of subsets of X which are C-definable. An accept- 
able enumeration {W- of C[X] is an enumeration obtained from accept- 
able enumerations (W^^^^^'^^ ■* )jgN of r.e. subsets of the X x ({0, l}*)'^'s 
as follows: 

^s;An;[x] ^ p (X \ W^) where i = (j, A;) 

^E;vnO[x] ^ ^Xu(x\tyX) where i = (j,fc) 

^3.nE0An0)[x] ^ 3<,^(EOAnO)[xx({o.irn ^herei = 0-,m) 

2. Let C[X X P(N)] be the family of subsets of X x P(N) which are C- 

C[X1 

definable. An acceptable enumeration (Wj )iGN of C[X x -P(N)] is defined 
similarly from acceptable enumerations (yy^^^^'''-^^ ^ ^^^^^)ieN of sub- 
sets of the X X ({0, l}*)'"'s. 

3. Let A C N and C"^ be the ^-oracle syntactical class associated to C. 

r^l 4 

An enumeration {W^ )igN of C [X] is uniform if it is obtained from an 
acceptable enumeration (wf of C[X x -P(N)] by fixing the second 

order argument. I.e. wf*'^' = {x G X : (x,^) G >v^Px^W]|_ 

2.6 The mill and max operators 

The following definitions and results collect material from [5l H] . 

Definition 2.13. Let X be some basic set. We denote min and max the 
operators which map partial functions (/9 : X x N ^ N and partial functionals 
<I> : X X P(N) X N ^ N onto partial functions min (p, max (p : D ^ N and 
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functionals min max ^ : D ^ N such that 

(min(/?)(x) = mm{ip{x,t) : f € N A ip{x,t) is defined} 

(max(^)(x) = max{99(x, t) : t G N A 99(x,t) is defined} 

(min<I>)(x, A) = min{$(x, A, t) : t e N A 0(x, t) is defined} 

(max$)(x,A) = max{$(x, A, t) : t G N A (/)(x, t) is defined} 

with the convention that min and max and the max of an infinite set are 
undefined. 

2. We let 

Minf]^^ = {min<^:(^ePi2^x^^^} 
Pi 

''PC 



Minf-^^ = {min(^:(^GPi?^>^"'^} 
MmJ^^(^)-^^ = {min$:$ePC^W^^>^^- 



The classes Maxf^^, Max^^^ and Max^^^^^^^^ are defined similarly 
from the max operator. 

Note 2.14. 

1. Simple examples of functions in Miupj^ are Kolmogorov complexities K 
and H. Examples of functions in Maxpj^ are the Busy Beaver function and 
the (partial) function giving the cardinal of Wn (if finite). 

2. The functional JC{ \\ ), defined in ^ is in 

Let's mention an easy result as concerns the syntactical complexity of 
these functions. 

Proposition 2.15. Any function in Minf,~I^^UMax^~]f^ has S^AllJ graph. 

The result extends to functionals and also relativizes. 

Proof. Observe that y = (min y?) (x) can be written 

(3t y = (/?(x, t)) A (Vt Vs ((/?(x,t) converges in s steps =^ y < ip{x,t))) 
Idem for y = (max ip) (x) with > in place of < . □ 

We shall use the following straightforward corollary of the above Propo- 
sition. 

Proposition 2.16. All functions in Miup^^ and Maxpj^ are partial recur- 
sive in 0'. 

An enumeration theorem holds for the families introduced in Def l2.13l 
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Proposition 2.17. There exists an acceptable enumeration of Minf,~^^ 

(where acceptable means that the analogs of conditions i~iii of Def [27S\ hold. 
In particular, the function (i,x) i— s- (/>i(x) is itself in Min^^^^ ). 

Idem with the class Maxfrj^^ and the functional classes Mirip^^^^^^^ and 

The following simple result about Miupj^ and Maxp^ will be useful. 
Proposition 2.18. 

1. 7/ G Minfj^^ and f :Y is in PR^-*^ then (p o f e Minf^^. 
Idem with Maxpj^ in place of Miupj^ . 

2. If if) ^ Min^Tji^ is monotone increasing and (j) € Minf,~^^ then ip o cf) ^ 

Proof. 1. Let (/)(x) = min^ (/^(x, t) where ip is partial recursive. Then 4>{f{j)) = 
mint ip{f{y),t) is in MinJ,~^^ since ip{f{y),t) is in PR^^'^. 

2. Let 0(x) = mint(^(x,t) and i){x) = mmu6{x,u) where ip,9 are partial 
recursive. Since ^p is monotone increasing, letting (7ri,7r2) : N — > be the 
inverse of Cantor bijection, we have 

■0((/>(x)) = ip{mmtip{x,t)) 

= mmt{i){ip{x,t))) 

= mint {miiiuO (if {x,t),u)) 

= min^6'((/7(x,7ri(f)),7r2(v)) 

which is in Minp^^ since 0((/5(x, 7ri(f )), 7r2(v)) is partial recursive. □ 



3 Coimmunity and density 

3.1 Constructive coimmunity and constructive density 

A classical result about Kolmogorov complexity K, due to Barzdins (cf. [9] 
Thm.2.7.1 iii, p. 167, or Zvonkin & Levin, [17J p. 92.), states that if is total 
recursive and tends to +oo then 

{x : K{x) < ip{x)] 

is an r.e. set which meets every infinite r.e. set, i.e. {x : K{x) < ^p{x)} D Wi 
is an infinite r.e. set whenever Wi is infinite. 

(The case is monotone increasing is due to Kolmogorov, cf. [17J p. 90, or 
[9] Thm.2.3.1 iii, p.119-120). 

In particular, K has no total recursive unbounded lower bound. 

In ^ we extend in various ways this result to sets which are no more r.e. 
sets and involve Kolmogorov complexities K^^^ or -fCjiiax- We also consider 
effectiveness of such properties in a sense related to the notion of constructive 
immunity, first considered in Xiang Li, 1983 [10] (cf. Odifreddi's book |llj 
p.267). 
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Definition 3.1. Let (Wj)jgN be an acceptable enumeration of recursively 
enumerable subsets of some basic set X. 

li. (Dekker, 1958). A set X C X is immune if it is infinite and contains no 
infinite r.e. set. 

lii. (Xiang Li, 1983 [IH])- A set X C X is constructively immune if it is 
infinite and there exists some partial recursive function : N ^ X such that 

Vi {Wi is infinite ip{i) is defined A ip{i) S Wj \ X) 

2i. A set Z C X is S^-dense if it contains an infinite r.e. subset of any 
infinite r.e. set included in X. 

2ii. A set Z C X is constructively S^-dense if there exists some total 
recursive function A such that 

Vi {Wi is infinite =^ ^^A{j) infinite subset of Z (1 Wi) 

Note 3.2. Rogers'Thm J2.8l insures that the above notion of constructive 
immunity and S^-density do not depend on the chosen enumeration of r.e. 
sets. 

Proposition 3.3. Z C X is constructively immune if and only if it is infinite 
and its complement is constructively S^-dense. 

Proof. <^=. Let (p{i) be the point which appears first in the enumeration of 
^A(0 (of course, (p{i) is undefined in case Wx^i) is empty). 

Define a partial recursive function ij,{i, n) which satisfies: 

- /^(«,0) = ^p{i) 

- fj,{i, n + 1) = (p{in) where in is such that Wj„ = \ {n{i, m) : m < n} 
Using the parametrization theorem, let A be total recursive so that Wx(i) = 
{n{i, m) : m G N}. If Wi is infinite then all fi{i, m)'s are defined and distinct 
and belong to Wi n Z. Thus, Wx(i) is an infinite subset of Wi Ci Z. □ 

In case Z is r.e., constructive S^-density amounts to say that Z CiWi is 
infinite whenever Wi is infinite. 

Barzdin's result gives an instance of a constructively S^-dense r.e. set. Other 
examples are maximal r.e. sets. 

Proposition 3.4. Any maximal r.e. set Z is constructively T,^-dense. 

Proof. Let Z C X be r.e. where X is some basic set. We prove that for every 
infinite r.e. set Wi C X the intersection Z DWi is also infinite. 
In fact, suppose Z fl Wi is finite. Then Wi\Z is an infinite r.e. set disjoint 
from Z. Thus, Z' = Z U Wi is an r.e. set containing Z such that the 
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difference Z' \ Z = Wi \ Z is infinite. Since Z is maximal this implies that 
Z' is cofinite. Thus, 

X\Z = {X\Z')U {Wi \{Zn Wi)) = Au{Wi\B) 

where A, B are finite sets. Hence X \ Z is r.e. and, consequently Z is 
recursive. A contradiction. □ 

3.2 Uniform constructive density 

In order to deal with Kolmogorov complexities , , . . . and their Min/Max 
versions, we shall consider constructive density for sets. This will be done 
through relativization of E^-density with respect to jump oracle 0^""^^. 

There is two natural ways to relativize Sj-density to an oracle A : 

(*) Consider the W/^^s and ask for A A-recursive. 
(**) Consider the H^^'s and ask for A recursive. 

The second way, which is the stronger one, will be the one pertinent for 
applications to Kolmogorov complexities. Of course, to deal with (**), we 
must consider uniform enumerations of A-r.e. sets and partial ^-recursive 
functions (cf. Prop l2?7|) . i.e. we have to consider the notion of constructive 
density with functionals. This will, in fact, give a strong version of (**) in 
which \ is a total recursive function which does not depend on A. 

Definition 3.5. 

1. Let Z C X X P(N). For ACN, let's denote = {x G X : (x. A) G Z}. 
Consider an acceptable enumeration (>Vi)igN of subsets of X x P(N) (cf. 
Defi23]) and let W,^ = {x : (x. A) eWi}. 

Z is constructively S^-dense if there exists some total recursive function A 
such that, for ah i G N and ah A G P(N), 

(*) Vi G N G P(N) {W^ is infinite 

=^ ^A(i) infinite subset of W^ H Z^) 

2. Z C X is constructively uniformly S'j''^-dense if there exists some con- 
structively S?-dense set 2: C X x P(N) such that Z = Z^ . 

In particular, there exists some total recursive function A such that 

(**) Vi G N {yV^is infinite VFj^^^is an infinite subset ofW^ 

When A = 0("~^) we shall also say that Z is constructively uniformly S^- 
dense. 

Note 3.6. Thm l2.8l insures that the above notion of constructive uniform 
S^'^-density does not depend on the chosen enumeration of yl-r.e. sets, as 
long as it is uniform, cf. Prop 031 
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Remark 3.7. Using Point 2 of Prop 1221 one can suppose that if IS 
infinite then Wx{i) ^-recursive and an A-x.e. code for its complement is 
given by another total recursive function A'. 

Note 3.8. In the vein of what we mentioned at the start of if (p : 
N — > N is total A-recursive and tends to +oo then Lemma J8.1l insures that 
is an A-x.e. set which is uniformly constructively S^' - 
dense. In case ^{x) <ct log(x), this set is coinfinite since it excludes integers 
with incompressible binary representations. 

Remark 3.9. Immunity can also be relativized according to the different 
policies (*) and (**). Also, Prop lSTSl admits straightforward extensions to 
the functional setting and the uniform relativized one. 

Finally, let's observe that Prop l3^ relativizes in the uniform sense. 

Proposition 3.10. Any maximal A-r.e. set Z is uniformly constructively 
T,i'^-dense. 

Proof. Let Z = {x : {x,A) e Z} where Z C X x P(N) is S?. There is a 
total recursive function 9 such that, for all A and i, Z Ci Wj = Wg^{^. In 
particular, ZnW^ = W^^^) and the argument of Prop {331 goes through. □ 



3.3 Constructive (C, r')-density 

Comparison of K and K^^^ , K^g^^ in the hierarchy theorem 18.141 leads to a 
particular version of constructive density applied to and to sets and 
involving subclasses 3-^(S5 A IlJ) of A2 sets described in Def l2.9l below. 

We now introduce some central notions of this paper. 
Definition 3.11. Let X be a basic set. 

li. Let S, T be families of subsets of X. A set Z C X is (5, T)-dense if for 
every infinite set X £ S the intersection Z D X contains an infinite subset 
Y which is in T. 

ii. Let S,T be families of subsets of X x P(N). A set Z C X x P(N) is 
(<S, T)-dense if for every X £ S there exists y £ T such that, for every A, 
letting X^ = {x: {x,A) G X}, 

X"^ is infinite =^ is infinite and included in n Z^ 

2. Let C^T) be syntactical classes as in Def l2.12l 

i. Z is constructively (C,I')-dense if it is (C[X], 2?[X])-dense in the sense of 
li above and, moreover, a P-code for Y can be recursively obtained from 
a C-code for X. In other words, there exists some total recursive function 
A : N ^ N such that, for ah i 

wf^"^ is infinite ^ VFw?^ is infinite and included in W''''^' n Z 
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ii. A set 2 C X X P(N) is constructively (C,P)-dense if it is (C[X],D[X])- 
dense in the sense of lii above and, moreover, an D-code for y can be 
recursively obtained from a C-code for X. In other words, there exists some 
total recursive function A : N ^ N such that, for all i 

is infinite and included in (w^fir^xPim n Z^) 

Note 3.12. 

1. Clearly, (constructive) (S^, S]')-density is exactly (constructive) S^- 
density in the sense of Def l3.5[ 

2. See Lemmas 18. 6( 18.81 for examples of constructive (S^, 3-'^(S]' A n^))- 
density and (H?, 3^^'(S'j' A n'j'))-density. 

Let's state a simple result about (C, I')-density. 

Proposition 3.13. 

1. The family of (constructively) (C, V)-dense subsets ofX (resp. X x P(N) ) 
is superset closed. 

2. Let Zi,Z2 ex. If Zi is (constructively) {C,'D)-dense and Z^ is (con- 
structively) {'D,£)-dense then Z\ Ci Z2 is (constructively) (C, £)-dense. 
Idem for Zi, Z2 C X x P(N). 

Proof. Point 1 is obvious. As for point 2, let X be an infinite set in C[X]. 
Using (C, X')-density of Zi we (recursively) get (a code for) an infinite Xi C 
X n Zi in T>. Then, using (P, £')-density of Z2, we (recursively) get (a code 
for) an infinite X2 C Xi n Z2 ^ X n {Zi D Z2) in E. 

For Z\.,Z2^?i C X X -P(N), fix the second order argument A and argue 
similarly with Z^,Z^,X^. □ 

4 The OftLess relations and the <C orderings 

In this § we introduce the central notions of this paper to compare the 
growth of total functions /, 3 : N ^ N. 

4.1 Relations OftLess^''' , OftLess^^ on maps N — N 

Definition 4.1. Let C^T> be syntactical classes (cf. Def J2.12]) and T be 
a countable family of functions N ^ N and {<^i)i^^ be a (non necessarily 
injective) enumeration of (in ^jSj will be PK or Miupj^, cf. Def l2.13]) . 

We let / OftLess^'^ g (resp. / OftLess^^ g ) be the relation between 
total functions /, 5 : N — > N defined by the following conditions: 
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i. For every total (resp. and monotone increasing) function : N ^ N in 
T which tends to +00, the set {x : /(x) < ^{^g{x)y\ is constructively 
(C, P)-dense. 

ii. The constructive (C, P)-density in condition i is uniform in </) : There 
exists some total recursive A : — > N such that, for all i, j, 

is total (resp. and monotone increasing) and tends to +00 
A is infinite 

=^ ^A(i j) infinite subset of fl {x : fix) < (f)i{g{x))} 

Remark 4.2. 

1. The notation OftLess stresses the fact that / is often much smaller than 
g : consider functions (f) which are much smaller than the identity function, 
e.g. max(0,z-c), [z/c\, [log(z)J , log*(2:),. . . 

C X' 

2. OftLessy carries the contents, reformulated in terms of uniform con- 
structive (C, 2?)-density, of Barzdins result cited above, and that of adequate 
variants that we shall prove about i^^niax -^min Lemmas 18. H 18.61 

EED. 

3. Suppose J- contains all translation functions z 1— > max(0, z — c). If 
/ OftLess^^ g (a fortiori if / OftLess^''^ g) then g is necessarily un- 
bounded. Else, if c is a bound for g, consider (j){z) = max(0, z — c) to get a 
contradiction. 

4. OftLess^^ is an extension of OftLess^''^ which has much better 
properties (cf. Thm l4.4"l) . 

4.2 Monotonicity versus recursive lower bound 

In case J- = PR, the monotonicity condition can be put in another equiva- 
lent form. 

C 

Proposition 4.3. Relation f OftLesSp^| g holds if and only if conditions 
i, ii in Def \4-1\ hold for every total functions 4',(pi : N — > N which recursively 
tend to +00, i.e. there are recursive growth modulus N ^ N such that 

ViV Vn > ^(iV) (p{n) >N , ViVVn > (,i{N) (j)i{n) > N 

Proof. =^ . If is total recursive and monotone increasing and tends to +00 
then it tends recursively to +cxd : a possible recursive growth modulus is 

C{N) = least X such that (/)(x) > N 

<^ . Observe that any total (f) € PR which tends recursively to +00 has a 
total recursive minorant ip which also tends to +00, namely 

V'(o) = (^(o) , V'(iv + 1) = + ^(iv))) 

where ^ is a recursive growth modulus of (p. 

Of course, if true for ip, conditions i, ii are also true for (p. □ 
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4.3 Transitivity 

It is clear that if C ^ V then OftLess^'^ and OftLess^^ may not be 
transitive, hence may not be orderings. However, we have the following 
result. 

Theorem 4.4 (Transitivity theorem). 

1. Let 3,0,1) be syntactical classes and T,Q he countable classes of func- 
tions containing the identity function Id : N ^ N. Then, 

i. e OftLess^'*" / OftLesSg''^ g =^ e OftLesSg''^ g 

e UitLesSgi g 



ii. e OftLess^'l' / OftLessg'-j^ g 



e UitLessyi 



In case T is recursively closed by negative translation of the output, i.e. 

(p ^ T =^ Vc max(0, (p - c) ^ T 
and there exists a total recursive function ^ : ^ N such that 

max(0, (j)i-c) = (t)e(^i^c) 

then 

Hi. e <ct / OftLess^'^ g =^ e OftLess^'^ g 

In case J- is recursively closed by negative translation of the output and also 
by negative translation of the input, i.e. 

(j) £ =^ Vc X 1-^ (/)(max(0, x — c)) £ 
and there exists a total recursive function C : — s- N such that, for all x, 

(j)i{max{0,x - c)) = (/>c(j,c)(a;) 

then 



IV. 



e <ct / OftLess^^ g <ct h e OftLess^^ h 



2. Case C = T>. Relations OftLess^'' and OftLess^^ are strict orderings. 

Proof, li. Suppose e OftLess^'*" / OftLesSg'^ g. Observe that 

{x : e(x) < f{x)} n {x : f{x) < (pigix))} C {x : e{x) < (pigix))} 

Since Id € J^, the sets on the left are respectively constructively {B, C)- 
dense and (C, X>)-dense, uniformly in (p. Applying Prop i3?T3l we see that 
{x : e{x) < (t>{g{x))} is constructively (jB, P)-dense, whence e OftLesSg' g. 

Hi. The above argument also gives e OftLesSg|^ g. To get e OftLess^'^ g, 
argue as above and observe that 

{x : e{x) < 0(/(x))} n {x : f{x) < g{x)} C {x : e{x) < (/'(^(x))} 
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whenever (p is monotone increasing. 

liii. Let c be such that e{x) < f{x) + c for all x. 

li (p £ J- is total and tends to +00, so is its negative output translation 

4>c{z) = max{0, (f){z) — c} 
Suppose f{x) < 4)c{g{x)). Then (pdgix)) > so that 

Moix)) = (t>{g{x)) - c 

fix) < 0(5(3;)) -c 

e(x) < f{x) + c < (t){g{x)) 
This proves the following inclusion 

{x : f{x) < Maix))} Q {x : e(x) < (pigix)} (1) 

Relation / OftLessy g insures that {x : f{x) < (j)c{g{x))} is constructively 
(C, P)-dense. Inclusion ([T]) implies that the same is true with {x : e(x) < 
(j){g{x))}. Since a code for (pc is recursively obtained from a code for (p, this 
proves e OftLess^'^ g. 

liv. Let c be now such that e(x) < f{x) + c and g{x) < h[x) + c for all x. 
li (p £ T IS total, monotone increasing and tends to +cx), so is its negative 
input and output translation 

(pc{z) = max{0, (/)(max(0, z — c)) — c} 

Suppose f{x) < (pc{g{x)). Then (pc{g{x)) > so that 

(j^cigix)) = (A(max(0, g{x) - c) - c 
f{x) < (p{max{0, g{x) — c) — c 
e(x) < f{x) + c < (p{m.ax{0, g{x) — c) 

Now, g{x) < h{x) + c and (p is monotone increasing, hence 

e{x) < (/)(max(0, g(x) — c) < (/)(max(0, /i(rc)) = (p{h{x)) 

This proves inclusion 

{x : /(x) < ^c{g{x))} C {x : e(x) < (P{h{x)] (2) 

Relation / OftLess_^-^ g insures that {x : f{x) < (pc{g{x))} is constructively 
(T>, £)-dense. Inclusion ^ implies that the same is true with {x : e{x) < 
(l){h{x))}. Since a code for (pc is recursively obtained from a code for cp, this 
proves e OftLess^^ h. 

2. Transitivity of OftLess^'' and OftLess^^ is an obvious consequence of 
li-ii. As for irreflexivity, arguing with (p = Id ^which is in J^), we see that 
f{x) < 0(/(x)) is impossible, so that / OftLess^^ / and / OftLess^^ / are 

c c c c 

always false. Thus, OftLessy and OftLessy* are strict orderings. □ 
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4.4 Orderings , on maps N ^ N 

Points iii-iv of the above theorem show that taking intersection with the 

c Ty 

"up to a constant" ordering <ct transforms the relations OftLessy and 
OftLess^^ into strict orderings <C^'^ and • 

Definition 4.5. <C^^ and '^'jr^ are the intersections of the OftLess^''^ 
and OftLesSj^i relations with the <ct ordering on total maps N — > N. 

Theorem 4.6 ( and '^j^ are strict orderings). 

Let A, 3,0,1) be syntactical classes and let J-,Q be countable classes of func- 
tions N ^ N which contain Id and which are recursively closed by output 
and input translation (cf. Thm \4-4^ relative to some enumerations of J^,Q. 
Then 

I. e <y f 9 ^ e <g' g 

e <^^^ g 
BV 

e g 

m. e <ct / <g g ^ e <SLg g 

iv. e <ct / <-gf g <ct h ^ e <.gf h 

In particular, properties Hi and iv can be applied with <ct replaced by ^^'^ 
or . 

Relations <S^'^ and '^^'^ are strict orderings such that 

V. f g ^ f g =^ f <ct g 

Proof. Conditions i-iv are straightforward consequences of the similar con- 
ditions in Thm j4.4"l 

C 1^ C 

Condition i-ii yields transitivity of <Cj?^ and ^jp^ • 

Implication / ^^'^ g ^ f ^^i' 5 is trivial. Let's prove that <C^'^ re- 
fines <ct (and not merely <ct)- 

Suppose / <C^'^ g. Then / <ct g- Also, letting ^^{z) = max(0,2; — c), 
we see that {x : f{x) < jp{g{x)} = {x : f{x) < g{x) — c} is infinite, hence 
the condition Vx g{x) < f{x) + c is impossible, whatever be c. Thus, 
/ <ct g- □ 

C D 

The above theorem shows that composition of the orderings and 
c iy 

<Cy| is remarkably flexible. In particular. 
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Corollary 4.7. If 1 < i < n and l<j<k<m<n then 

fo "^^if^ ■ ■ ■ ^^nt^" /" ^ /o "^^if' fn 
fo <%t' ••• "^^nV'*^" -^^ ^ ^^kt" ■^'^ 

4.5 Left composition and 

Def ]4.1l 14.51 compare total functions /, g : N — > N via the associated sets 
{x : f{x) < (l){g{x))} for cp £ J^. One could also compare f,g via the sets 
{x : (j){f{x)) < g{x)} for (p £ J^. Similar properties could be derived. 

c iy 

Though we shall not use it in the sequel, there is a property of <cy and 
<Cjf^l which is interesting on its own and gives an alternative definition of 

<Cy and ^jc^i where the inequality /(x) < gets a symmetric form 

ip{f{x)) < (j){g{x)) involving functions on both sides of the inequality. 
We prove it in case T is PR or Miup^. 

Proposition 4.8. Let C,!) be syntactical classes and T he PR or Miupj^. 
Let ip -.N ^ N be a total recursive function. Then 

f <^ g =^ ipof <^ g 
/ 9 =^ iJ°f g 

C 

Moreover, the constructive density afferent to the relations ip o f g 
and ip o f g is uniform in ip. 

Proof. 1. Let : N — s- N be a total function in which tend to +oo. We 
prove that {x : 'ip{f{x)) < (p{g{x))} is constructively (C, I?)-dense. 
Set ip'iz) = max{z,max{'ip{u) : u < z}). Then ^p' > Id is total recursive, 
monotone increasing and unbounded. Since ip < ip' , we have 

{x:i;'ifix))<^{g{x))} C {x : ij{fix)) < (t>{g{x))} (3) 

2. Define a, C : N ^ N as follows: 

a{z) = largest u such that 'ip'iu) < (p{z) 

C{z) = smallest s such that ^p' is constant on [s, a{z)] 

Since and tp'{z) tend to +oo so do a{z) and Also, 

Vn<C(^) i;'{u)<ij'iC{z))=^P'{a{z))<^{z) (4) 

Finally, a and ( are in J^. If = PR, this is trivial. If JT = Mirip^ 
and (^{x) = m.va.t4>t{x) then observe that a{x) = mint Oit{x) and C{x) = 
mint Ct{x) (where at, Ct are defined from ip, <pt as are a, C from ip, (p). 
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3. Condition (jl]) applied to z = g{x),u = f{x) insures 

f{x) < C{g{x)) ij'Uix)) < 

whence 

{x : /(x) < C(5(x))} C {x:i,'{f{x))<cP{gix))} (5) 

Condition / OftLess_^ g applied to C insures that {x : /(x) < C,{g{x))} is 
constructively (C, X')-dense. Using inclusions ([5|) and ([3]), we see that so is 
{x : ^l;{f{x)) < Hg{x))}. 

c iy 

4. In case / OftLessy^ g, then <j) is monotone increasing. Since is also 
monotone increasing, so are a, C, and we get ^ o / OftLess^'^ g. 

5. Finally, observe that all the construction is uniform in tp and </>. □ 

5 Functional Kolmogorov complexity 

The purpose of this section is to reconsider the oracular version of Kol- 
mogorov complexity. We shall view the oracle as a parameter in a second 
order variant of conditional Kolmogorov complexity. 

5.1 Kolmogorov complexity of a functional 
Definition 5.1. Let X be a basic set. 

The Kolmogorov complexity /Ci? : X x P(N) N associated to a partial 
functional F : {0, 1}* x P(N) ^ X is defined as follows: 

/Ci?(x||A) = smallest |p| such that (F(p,A) = x) 

Note 5.2. 

1. Forgetting the A, we get the classical notion Kf{'^) with F : {0, 1}* X. 
Freezing the A also leads to the classical oracular notion. This is the con- 
tents of the next obvious proposition and of Thm l7.11 below. 

2. The double bar || is used so as to get no confusion with usual conditional 
Kolmogorov complexity where the condition is a first-order object. 

3. The above definition can obviously be extended to conditional Kol- 
mogorov complexity JCf{'>^ | y || yl) where F : {0, 1}* x Y x P(N) X. 

Proposition 5.3. Let F be as in Def \5.1[ For A € -P(N), denote 

: {0,1}* ^X 

the function such that F"^{'p) = F{p,A). Then, for all x G X, 

KpA{x) =/Cf(x||A) 
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5.2 Functional invariance theorem 

The usual proof of the invariance theorem (Kolmogorov, 1965 [8]) extends 
easily when considering partial computable functionals {0, 1}* x P(N) N 
in place of partial recursive functions {0, 1}* — > N, leading to what we call 
functional Kolmogorov complexity and denote /C(x || A). 

Theorem 5.4 (Functional Invariance Theorem). 

1. Let T he the family of partial computable functionals {0, 1}* x P(N) — X. 
When F varies in T , there is a least Kp up to an additive constant: 

3F G ^ VG G ^ Kf <ct /Cg 

Such an F is said to be optimal in T . We let /C( || ) 6e Yip where F is some 
fixed optimal functional. 

2. Let {Fk)keN be a partial computable enumeration of PC^^'^^ xP(N)^x^ 
Let U : {0, 1}* x P(N) ^ X 6e such that 

U{{)Hv,A) = Fk{^,A) Z^(0'=) = 

Then U is optimal in pc'{o,i}*xP(N)^x_ 

Proof. It clearly suffices to prove Point 2. The usual proof of the classical 
invariance theorem gives indeed the functional version stated above. 

ICf^{x\\A) = min{|p| : Ffc(p,A) = x} 

= min{|p| :^/(0''lp,A) =x} 

= min{|0^1p| - A; - 1 : Z^(0'=lp, A) = x} 

> min{|q| - A; - 1 : Z^(q,^) = x} 

= min{|q| : l({q, A) = x} - k - 1 

= ICuix\\A) - k -I 

Whence fCu < JCp^ + k + 1 and therefore )Cu <ct ^F^- D 
Remark 5.5. 

1. Obviously, /Cir(x||A) does depend on A. For example, if x G N is 
incompressible then ]Cf{^ \ \ 0) =ct log(x) whereas /Ci?(x || {x}) =ct 0. 

The contents of the functional invariance theorem is that, for some F's (the 
optimal ones) the number 

max{/CF(x||^) -/Cg(x|| A) : x G N,^ G P(N)} 
is finite for any given G. 

2. For the functional invariance theorem, we only have to suppose the 
enumeration {Fk)k G N to be partial computable as a functional N x {0, 1}* x 
P(N) — > X. There is no need that it be acceptable (cf. Def ]2.5p . 



22 



As for the usual Kolmogorov complexity, computable approximation 
from above is possible. 

Proposition 5.6. There exists a total computable functional 

(x,t,A) gXxP(N) xN^/C*(x||^) 
which is decreasing with respect to t and such that, for all x, A, 

JC{x\\A) = min{/C*(x II A) : f G N} 
Proof Letting IC = ICu where IC G PCio,ir^N^ 

B{x,t,A) = {|p| : IpI < t A U{p,A) = x A U{p,A) halts in < t steps} 

r(x, A) = smallest t such that B{x, t,A) ^H) 
K:\x\\A) = smallest |p| G B{x, t, A) U B{x, T{x, A), A) 

□ 

6 The M in /Max hierarchy of Kolmogorov com- 
plexities 

Infinite computations in relation with Kolmogorov complexity were first 
considered in Chaitin, 1976 [3j and Solovay, 1977 [H]. Becher & Daicz & 
Chaitin, 2001 [IJ, introduced a variant of the prefix version of Kol- 
mogorov complexity by allowing programs leading to possibly infinite com- 
putations but finite output (i.e. remove the sole halting condition). This 
variant satisfies <ct H"^ <ct H (cf. [Il[2]). 

In [5], 2004, we introduced a machine- free definition i^jnax of the usual (non 
prefix) Kolmogorov version K°°, together with a dual version K^:^^. The 
proof in [2] of the above inequalities extends easily to the K setting for 
-^max- However, a different argument is required in order to get the K^^^ 
version (cf. [5j). 

6.1 Min/Max Kolmogorov complexities 

The following definitions and theorems collects material from [5]. The clas- 
sical way to define Kolmogorov complexity extends directly to these classes. 

Theorem 6.1 {Min/Max Invariance theorem). 

1. LetT heMin^p'^^'^^^ or Maxp^^*'"^ (cf. De Mim . When (j) varies m 
T there is a least K^, up to an additive constant (cf. Notation \2.1\) : 

G Minf^^*^^^ Mi) G Minf^^*^"^ <ct 
3(/. G Max^j'^*^^ V?/^ G Max^^l*-"^ K^, <,t 
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Such (f) 's are said to optimal in T . 
We let 

- -f^jjjjjj denote where (j) is any function optimal in Min^p'^ 

- i^max denote where <j) is any function optimal in Max^p'^ 

2. Suppose {4'k)keN is an enumeration of Min^^^ such that the function 
(A;,p) 1-^ 0fc(p) is in Min^'^^'^^ Let f/min such that 

f/min(0'=lp) = M?) f/min(0'=) = 0fc(A) 

Then C/min is optimal in Min^^^ 
Idem with Max^p^ . 

3. Relativizing to an oracle A C N, one similarly defines K^^^^ and -f^^^ax 
and the analog of Point 2 also holds. 

Remark 6.2 (|5])' There exists optimal functions for Max^p^ of the 
form max/ where / : {0, 1}* x N — > N is total recursive. 
This is false for Min^pp^ . 

Relativizing to the successive jumps oracles, we get an infinite family of 
Kolmogorov complexities for which holds a hierarchy theorem. 

Theorem 6.3 (The Min/Max Kolmogorov hierarchy, [5]). 

log>etK>ct >ctK^'>ct r >ctK^">ct T >ctK^ 



mm 7^0" mm 

i^^ax <ax 



Strict inequalities K >ct -K'max >ct K'^' >ct -f^max >ct were first 
proved by Becher & Chaitin, 2001-2002 [IJ (for the prefix variants). 

The main application of the <cy and <Cj^| orderings introduced in §3] 
is a strong improvement of this hierarchy theorem, cf. Thm l8.l11 

Finally, we shall need the following result (cf. [5j, or pLj as concerns i^max)- 

Theorem 6.4. K, K^^^, K^^^^ are recursive in 0'. 

6.2 Functional Min/Max Kolmogorov complexities 

The Invariance Theorems for Maxpp and Miupp (cf. Thm l6.lT) admit 
functional versions, the proofs of which are exactly the same as that in 
ThmiSa 

Theorem 6.5 (Min/Max Functional Invariance Theorem). 
1. When F : {0,1}* x P(N) N varies over Min^p;^^' ''^^^'^^^ or over 
ere is a least Kp up to an additive constant: 

3F G Mzn?W^^°'^>*-^ VG G M^4W^^°'^>*-^ ICp <ct ICg 
3F G MaxJW^^°'^>*^^ VG G MaxJ^^^^'^^*"^^ ICp <ct ICg 
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Such an F is said to be optimal in Miup^^^^^^'^^ or in Maxp^^^^^^'^^ 
We let K^^^( II ) = and i^maxC II ) = be some fixed such optimal 
Junctionals. 

2. Let (Ffc)fcgpj be an enumeration of Miup^Q ^^^'^'^^ which is itself in 



Minp^^*-^^^^^'^^ LetUiain be such that 



Then U^^^ is optimal in Min^p^^ . 

One defines similarly Z^^ax which is optimal in MaXpQ. 

Remark 6.6. 

1. Using the technique of |5], we see that there exists optimal functionals 
for Maxp(j of the form maxF where F : {0, 1}* x N x P(N) ^ N is total 
recursive. This is false for MiupQ. 

2. The inclusions PC C Maxp^ n Miup^j imply that \\ ) <ct ^( 1 1 ) 
and /Cjnax( II ) ^ct II ). Also, as is well-known, /C( || ) <ct log. We can 
choose /Cjjjiji , /Cjj^ax so that the constant is 0, i.e. for all x and A., 

)C^^{x \\A)<}C{x\\A)< log , /C^a^(x \\A)<}C{x\\A)< log 

3. In fact, the Min/Max hierarchy Theorem 16.31 extends to the functional 
setting. In §8.61 we shall prove a much stronger result, cf. Thm lS.l^ 



7 Functional versus oracular 

Functional Kolmogorov complexities allow for a uniform choice of oracular 
Kolmogorov complexities. The benefit of such a uniform choice was devel- 
oped in §1.21 and is illustrated in the hierarchy theorem in ^8.6[ 

Theorem 7.1. Denote K^, K^^^, K^^^^ : X ^ N the Kolmogorov com- 
plexities associated to the families PR^ of partial A-recursive functions and 
the families MiUppj^ , MaXppj^ obtained by application of the min and max 
operators to p_R^.XxN^N_ ACN, we have 

=ct ^( II ^) ) -^min ~ct ^mm( 1 1 ^) ' -^max =ct ^max( II ^) 

r |K^(x)-/c(x||A)i < CA 

ie. V A e P(N) 3cA Vx <^ |K;4.^(x) - fC^^{^\\A)\) < ca 

{ |k4,(x)-/C^^,(xM)|) < CA 

Proof. 1. We let (Ffc)^^^ and U be as in Point 2 of ThmEland let F^^(x) = 
Ffc(x, A) and [/"^(x) = Z//(x, ^4). The sequence (F^)fcgN is an enumeration of 
the family p^^.lo.i}*^^ of partial ^-recursive functions {0, 1}* X, which 
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is partial A-recursive as a function N x {0,1}* X. Since U^{0^1p) = 
F^(p), the classical invariance theorem, in its relativized version, insures 
that is optimal in pRAm}*^^^ whence =ct i^c/A. 
Now, U is optimal in pc'^(n)x{o,i}*^n^ whence /C( || ) =ct }Cu{ \\ )• 
Prop ED insures -K'^a(x) = /Ci^(x||74), whence =ct 1C{ \\A). 

2. The Min and Max cases are similar. □ 



8 Refining the oracular Min/Max hierarchy with 
the <C, <C| orderings 

8.1 Barzdins' theorem in a uniform setting 

The next lemma is essentially Barzdins' result cited in §3.11 In order (point 
2) to get a relativized result with 9 recursive rather than merely ^-recursive, 
we shall look at the oracle A as a parameter and use uniform Kolmogorov 
complexity, cf. gOl ^ 

Lemma 8.1. 

1. If 99 : N ^ N is total recursive and tends to +00 then {x : K{x) < 
is an r.e. set which is constructively Ti\-dense. 

Moreover, this result is uniform in (p. In fact, let and (Wi)igN 

he acceptable enumerations of partial recursive functions N — > N and r. e. 
subsets of N, there are total recursive functions ^ : N — > N and : ^ N 
such that 

i. Vi {x G domain{ifi) : K{x) < (pi{x)} = 

a. {ipi is unbounded on domain{ipi) n Wj 

=^ (Wg(jj) is infinite A l^e(i,j) ^ ^ ■ K{x) < ipi{x)})) 

2. Consider second order Kolmogorov complexity )C{x \ \ A) and an acceptable 
enumeration ($j)jgp} of partial computable functionals Nx P(N) — >■ N. Using 



Thm 7.1 and Prop \2. 7\ we shall consider IC{x\\A) as uniform Kolmogorov 
relativization K^{x) and ^i{x,A) as a uniform oracle A partial recursive 
function (pf{x). We also denote = domain{ipf) . 

Point 1 relativizes uniformly, i.e., the above total recursive functions ^ : 
N ^ N and : — > N can be taken so as to satisfy all possible relativized 
conditions, i.e. 

m 



i. Mi MA {x G domain{ipf) : K^{x) < ipf{x)} = Wf" 



a. Mi,j MA {iff is unbounded on domain{(pf) D 

infinite A 1^,^.^.) C Wf H {x : K\x) < ipfix)})) 



26 



Note 8.2. Lemma 18.11 is optimal in the sense that there is no possible 
(n]*, £^)-density result for {x : K{x) < f{x)} since this set has II^ comple- 
ment. 

Proof. Point li. Let K = Ku where U E Pi?^0'^>*^^. Then 

K{x) < ipi{x) ^ 3p (IpI < ipi{x) A C/(p) = x) 

which is a condition. Therefore {{i,x) : K{x) < ipi{x)} is r.e. and the 
parametrization theorem yields the desired total recursive function ^. 

Point Hi. 

In order to prove constructive S^-density uniformly in ip, we first define a 
partial recursive function a : x {0, 1}* N such that 

if there exists some x G Wj such that ipi{x) > 2 |p| then a{i,j,p) 
is such an x, else a{i,j,p) is undefined. 

Then we shall use the facts that 

K <ct K^^a(i,j,p) , K^>^a{i,j,p){o:{i,j,p))<ct\p\ 

to get an inequality K(a{i, <ct |p| from which K{a{i, < 9Jj(p) 
can be deduced. 

a. The formal definition of a as a partial recursive function is as follows. 
Denote Wj^t the finite subset of Wj obtained after t steps of its standard 
enumeration. Let : x {0, 1}* P(N) be such that 

Zt{i,j,p) = {x G Wj^t '■ halts in < t steps and is > 2 |p|} 

Clearly, {(t,z,j,p) : Zt{i,j,p) / 0} is a recursive subset of x {0,1}*. 
Thus, we can define the partial recursive function a as follows: 

domain{a) = {(i,i,p) : 3t Zf(i, j,p) 7^ 0} 
a(i,j, p) = the first element in j, p) 

where t is least such that Zt{i,j,p) 7^ 

Let be an acceptable enumeration of PR^^'^^*^^ . Since a is partial 

recursive, there exists a total recursive function : — s- N such that 
Q'(^)J)P) = ■077(4 j)(p) ^or all i,j,p. Finally, we let ^ be a total recursive 
function such that 

^0{i,j)=i^ri(i,j){{P-\p\>v{hj) A {i,j,p) e domain{ip^(^ij))}) 
Since a and ipniij) take values in Wj, we have Wg(j C Wj for all i,j. 

b. Let U : {0, 1}* ^ N be such that [/(O'^lp) = ^pk{p) and U{0'') = V'fc(A) 
(where A is the empty word). The usual invariance theorem insures that U 



27 



is optimal. Thus, we can (and shall) suppose that K = Ku. 

Since a(i,j,p) = ■0^(jj)(p), we have Q!(i,j, p) = [/(C'^^'-^Hp). Thus, for any 

(^) j)P) ^ domain{a), 

K{a{i,j,p)) = Ku{U{0^^''^hp)) < \0^(''^hp\ = IpI +r/(i, j) + 1 

c. Suppose now that is unbounded on domain{ipi) fl Wj. Then, for all p, 
the set Zt{i,j,p) is non empty for t big enough, so that a{i,j,p) = i^r){i,j){p) 
is defined for all p. Also, due to the definition of Zt, we see that a{i,j,p) 
tends to +00 with the length of p. In particular, j) is infinite. 
From the definition of a, we see that (pi{a{i, > 2|p|. Using b, we see 
that for all |p| > r]{i,j), we have K{a{i, < 2p < if{a{i,j,p)). 
This proves that Wg(^ij) is included in {x : K{x) < ipi{x)}. 
Thus, VFe(ij) is an infinite r.e. set included in Wj n {x : K{x) < 

Point 2i. Let /C( II ) = Ku where U G PC^Wxfo.il'^N^ ^^^^ 

K'^ix) < ipfix) ^ 3p (IpI < ipfx A Uip,A) = x) 

which is a condition. Therefore {{i,x,A) : K^{x) < ff{x)} is and 
the parametrization property (cf. Def i2.5p yields the desired total recursive 
function ^. 

Point 2ii. The proof is similar to that of Point lii. Just add everywhere 
a second order argument A varying in P(N) and use the parametrization 
property of Def l2.5[ Thus, a is now a partial computable functional 

a : X {0, 1}* x P(N) ^ N 
The enumeration now becomes an enumeration of the partial 

computable functionals {0, 1}* x P(N) N. The total recursive functions 
rj^O are now such that a(i, j, p, ^) = ^'^(j j)(p, ^) and 

^e{i,j) = {%(i,j)(P>^) : P such that (i,j,p, A) G domain{a) A |p| > ri{i,i)} 

The arguments in h,c above go through with the superscript A everywhere 
and with lA (cf. proof of Point 2i above) in place oiU . □ 

Remark 8.3. 

1. Lemma l8.ll still holds for (j) G Maxp^ in place of 93 G Pi?. However, 
this does not really add: an easy argument shows that if (/> G Maxp^ and 
Wj C domain{(p) is infinite then there exists an infinite ^ Wj and <pi G 
PR such that W^ C domain{ipi) and '^i{x) < 4>{x) for all x G doraain[(pi). 
Moreover, k and i can be given by total recursive functions depending on j 
and a code for (j) in Maxp^. 

This also holds uniformly: replace by a functional <I> G PC. 

2. Of course, Lemma 18.11 cannot hold for (j) ^ Miupp since X is itself in 
Miupp. 
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8.2 Comparing K and -f^max ^ Barzdins 

In this subsection and the next one, we now come to central results of the 
paper, namely, 

- K can be compared to -f^max > -^min ''^^^ ^ '^^'^ orderings, 

- -f^max' -^min '^'^^ compared via the OftLess^ relation. 



Notation 8.4. We shall write X is (Ci UC2, I^j-dense to mean X is (Ci, P)- 
dense and (C2, 1')-dense. 

Remark 8.5. Let Ci V C2 be the family of sets Ri U R2 where Ri S Ci and 
R2 G C2. 

If Ci , C2 both contain the empty set (which is usually the case) , then C1DC2 Q 
C1VC25 and therefore (Ci VC2, 1')-density (resp. constructive density) always 
implies (Ci U C2, 1')-density (resp. constructive density). 
Conversely, every infinite set in Ci V C2 contains an infinite subset in Ci 
or in C2, so that (Ci U C2, 1')-density implies — hence is equivalent to — 
(Ci V C2 , 2?)-density. However, this is no more true as concerns constructive 
density: if Ri U R2 is infinite one cannot decide (from codes) which one of 
i?i and R2 is infinite. 

Lemma 8.6. 

1. Suppose (/) : N ^ N is a total function in Miup^ which is monotone 
and tends to +00. Then the set {x : i^niax(^) < constructively 
(S? U n?, 3^^<^(S? A n1))-dense (cf. Defl3Jl\ Point 3). 

Moreover, this result is uniform in cp. In fact, let {(pi)i(zf^ and {Wi)i£fq be 
acceptable enumerations of Miupj^ and r.e. subsets 0/ N. There are total 
recursive functions Oq, ^1 : ^ N such that, for alli,j, k, with the notations 
of Def \2.1^ if (pi G Miupj^ is total, monotone and tends to +00 then 

Wj is infinite ^eo{ij) ^ ^ is an infinite subset of 

Wj n {x : K^,,{x) < HKix))} 
N \ VFfc is infinite ^ei{i k) ^ ^ is an infinite subset of 

{n\Wk)n{x:K,,,,{x)<^{Kix))} 

2. Consider Kolmogorov relativizations K"^, K^^^y. obtained from second 



order Kolmogorov complexities /C,/C„^ax ('^f- Thm 7.1) and enumerations 
{4>f)i^N o-nd {W^)i,zfi of Miupj^ and A-r.e. sets which come from acceptable 
enumerations of functionals in Min^'^^^^^^^ and ofTi\ subsets o/NxP(N) 
(cf. Prop \2. 7| ). We shall also use notations from Def \2.1^ 
Point 1 relativizes uniformly, i.e., the above total recursive functions 6q,9i : 
^ N can be taken so as to satisfy all possible relativized conditions. I.e., 
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if (f>f G Miripj^ is total, monotone and tends to +00 then 

Wj is infinite =^ ^do{ij) ^ ^ ) is an infinite subset of 

N\ Wi^ is infinite =^ ^6»i(i fc) ^ ^ is an infinite subset of 

(N \ W,^) n {x : < 0^(i^^(x))} 

Proof. 1. The strategy. 

We essentially keep the strategy of the proof of Lemma l8.1i The idea is, for 
given i, j, to construct a Maxp^ function a : x {0, 1}* such that a(i, j, p) 
is in Wj (or in N\Tyj) and (^i(i^(a(i, j, p))) > 2 |p|. Then to use inequalities 

-f^max <ct K^^a(i,j,p) , Kp^a{i,j,p){o!{i,j,p)) <ct |p| 

to get an inequality K„,g,^{a{i, <ct |p| from which K^g^^{a{i, < 
ifi{K{a{i,j,p))) can be deduced. 

As we have to deal with sets and with sets, i.e. sets of the form Wj 
or N \ Wk, we shall define two such functions a, namely cto, ai. 
In order to get these functions in Maxpp, we define partial recursive func- 
tions ao, fli : X {0, 1}* x N ^ N and set maxao = ao and maxai = ai. 

2. Approximation of (pi from above. 

Let (j)i{x) = mint (pi{x,t) where ((/?i)igN is an acceptable enumeration of 

Using the parametrization theorem, let ^ : N — > N be a total recursive func- 
tion such that V'g(i) has domain {x : 3u ipi{x,t) does halt} x N and satisfies 

(/3^(j)(x,0) = ipi{x,u) where u is least such that ifi{x,u) does halt 
t + 1) = min({iy9^(j)(x, 0)} U f ) : t; < t and 

ifi{x,v) halts in < t steps}) 

Observe that t) is decreasing in t and 4>i{x) = min^ t), so that 

is a partial recursive approximation of 4>i{x) from above. 
Also, for any given i,x, either (pi{x) is undefined and is defined 

for no t or (/>j(x) is defined and (/9^(j)(x,t) is defined for all t. 

3. Functions and a^. 

Denote Wj^t the finite subset of Wj obtained after t steps of its standard 
enumeration. Denote K^{x) some total, recursive approximation of K{x) 
from above which is decreasing in t (cf. Prop EH]). 
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We define ao,ai as follows: 



ao(«,J,P,0) 



the element which appears first in the standard 
enumeration of Wj (hence undefined if Wj is empty) 



«o(«,J,P,i) Vi{i){K\ao{i,j,p,t)),t) > 2\i>\ 

X if (^^(j) {K\ao{i, j, p, t)), t) <2 |p| 

and X is the next element which 
appears in the standard enumeration 
of Wi and satisfies x > ao{i,j,p,t) 
undefined if (^^(j)(i^*(ao(^,j,p,^)),^) is undefined 



and 



ai(z, fc,p, 0) = 



ai{i, k,p,t + 1) 



if (f^(^i){K\ai{i,j,p,t)),t) > 2|p| 
and ai{i, k,p,t) ^ Wk,t 



ai{i,k,Tp,t) 

and ai{i, 

ai{i,k,Tp,t) + 1 if ip^(^i){K\ai{i,j,Tp,t)),t) < 2 |p| 



undefined 



or {ip^(i){K\ai{i,j,p,t)),t) > 2 |p| 
and ai(i, /c,p,t) G VFfc,t) 
if ip^(^i^{K^{ai{i, k,p,t)),t) is undefined 



Claim. Suppose (pi G Minp^ is total monotone increasing and tends to 

+ 00. 

a. If Wj is infinite then (p,t) ^ ao(^,j, p,t) and p ao(^,j, p) are total 
functions and 

Vp (ao(^,J,p) G A 0i(K(ao(i,j,p))) > 2|p|) 

b. Function ai is always total. //N \ Wk is infinite then p ai(i, A:,p) is 
a total function and 

Vp (ai(i,/c,p) ^ VFfc A UK{aiii,k,p))) >2\p\) 

Proof of Claim. 

As seen in 2 above, if 4>i is total so is This insures the total character 

of oo (resp. oi). 

Fix some p. Since (p^(^i-^{x,t) > (pi{x), (pi is monotone increasing and K,(f)i 
are total and tend to +oo, for all large enough x and all t, we have 

ip^^i^{K\x),t) > (t>iiK\x)) > (Pi{K{x)) > 2|p| 

Suppose Wj is infinite. Then there are elements in Wj which satisfy (t)i{K{x)) > 
21p|. Let ,To(i,j, p) be such an clement which appears first in the stan- 
dard enumeration of Wj. It is easy to see that, for all t large enough, we 
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have ao(i,j,p,t) = xo{i,j,p). Thus, ao{i,j,p) = xo{i,j,p) is defined and 
<^oihj:P) ^ Wj n {(j)i{K{x)) > 2 |p|}. Which proves Point a of the Claim. 

Suppose N \ Wk is infinite. Then there are elements in N \ which satisfy 
cf)i{K{x)) > 2 |p|. Let xi{i,k,p) be the least such element. It is easy to see 
that, for all t large enough (namely, for t such that Wfcn[0, xi{i, k, p)[C W^^t), 
we have ai{i, k,p,t) = xi{i,k,p). Thus, ai(i,fe,p) = xi(i,fe,p) is defined 
and ai(i, A;,p) G {N\Wk)n{(l)i{K{x)) >2|p|}. Which proves Point b of the 
Claim. □ (Claim) 

4- Functions r]^,6^. 

Let {ipn)n£'N be an acceptable enumeration of partial recursive functions 
{0,1}* X N ^ N. Since ao,ai : X {0, 1}* X N ^ N are partial recur- 
sive, the parametrization property insures that there exists total recursive 
functions r/o, r/i : — > N such that, for all k, p, t and e = 0, 1, 

ae{i,j,P,t) = V'r,,(j,j)(p,i) 

Taking the max over t, and letting = maxa^, we get, for all i,j,p, 

ae{i,j,P,t) = (maxV'r,,(ij))(p) 

For all k, set 

YeiiJ) = {ae{i,j,p) : (i,j,p) G domain{a^) A |p| > Veihj)} 

Using the Claim and inequality K(y) < y (which we always can suppose), 
observe that 

yeY,{i,j) ^ 3p (2 \p\<(Pi{K{y)) A \p\>i],{i,j) Ay = aeii,j,p)) 
<^ 3p (IpI < 0i(y) A |p|>?7e(i,i) A y = Qe(i, j, p)) 

Using PropEm we see that this is 3^'^'(i;? A H?) in i,j, y (cf. DefES]). 
We let ^1 : — 5- N be total recursive functions such that 

5. Point 1 of the Lemma. 

Let [/ : {0, 1}* X N ^ N be such that [/(O'^lp,*) = Vn(p,t) and U{Q'\t) = 
il^ni^^t) (where A is the empty word). Taking the max over t, we get 
(max C/)(0"lp) = (max'i/'n)(p) and (max{7)(0") = (maxV'n)(A). Since the 
max'i/'^'s enumerate Max^p'^ the invariance theorem 16.11 insures that 
maxC/ is optimal in Max^p'^ . Thus, we can (and shall) suppose that 

-^max -^(max U) ■ 

Since a,(i, j,p) = (max V'^^(ij))(p) = (max C/)(0'''(*'^)lp), we get 
i^max(«.(^J)P)) = K(^axC/)((max^)(0''^(^'^)lp) 

< ^e(i, j) + 1 + IpI 

< 2 IpI in case |p| > rj^{i^j) 
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Suppose (pi is total, monotone and tends to +00 and Wj (resp. N \ Wk) is 
infinite. Using the last inequality and that from the above Claim relative to 
e = (resp. e = 1), we see that, for |p| > ri^{i,j), we have 

^(maxi/)(ae(«,j,p)) < 2 [p| < (t)i{K {a^{i, j 

Which proves that (j j^^)^^'^^^^^' is included in {x : -K^rnax(^) < 4'i{K{x))}. 
Using the Claim again, this set is also included in Wj (resp. (N \ W^)- This 
finishes the proof of Point 1 of the Lemma. 

6. Point 2 of the Lemma. 

The proof is similar to that of Point 1. Just add everywhere a second or- 
der argument A varying in P(N) and use the parametrization property of 
Def l2.5l Thus, ao,ai are now partial computable functionals 

X {0, 1}* X P(N) X N ^ N 
The enumeration (V'n)ngN now becomes an enumeration (^'n)neN of the par- 
tial computable functionals {0, 1}* x P(N) N. The total recursive func- 
tions 7]^, 9^ are now such that 

ae{i,j,^,A,t) = ^'^^(ij)(p, 
ae(i,j,P,^) = (max^'^_^(jj))(p, A) 

= {ae(i, j,P,^) : (i,i,p,^) G domain{ae) A |p| > Ve{i,j)} 

and U has to be changed to U £ PC^Wxlo.ij-^N ^^^^i that /C( || ) = /C^. 
The arguments for the proof of Point 1 above go through with the superscript 
A everywhere. □ 



8.3 Comparing K and -f^mj^ a la Barzdins 

We shall need the following notion to get an analog of Lemma f8.6l with K^^^. 

Definition 8.7. The growth function of an infinite set X C N is defined as 

growthx{n) = (n + l)-th point of X 

The infinite set X has recursively bounded growth if growthx < ip for some 
total recursive function -0 : N — > N. 

Lemma 8.8. 

1. Let's denote H^'"^ the family of infinite subsets o/N with A-recursively 
bounded growth. 

Suppose (j) : N ^ N is a total function in Miup^ which is monotone and 
tends to +oo. Then the set {x : < (f){K{x))} is constructively 

(S? U n?, 3^^<^(S? A U^))-dense (cf. Defl3Al\ Point 3). 

Moreover, this result is uniform in cp and in a recursive bound for the 
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set. In fact, let (V'mjmeN (VFi)ieN be acceptable enumerations 

of Miupj^, PR and of r.e. subsets o/N. There are total recursive functions 
^0 : — i- N and 0i : ^ N such that, for all i,j, m, k, with the notations 
of Def \2.lA if 4>i G Mirip^ and tpm S PR are total, monotone and tend to 
+CX) then 

Wj is infinite =^ ^6o{ij) ^ ^ is an infinite subset of 
Wjn{x:K^^ix)<MK{x))} 

N \ Wk is infinite and ipm > gfowth^\y/^^ 

^ '^0i{ikrn) ^"^ infinite subset of 

{n\Wk)^{x:K^^{x)<UK{x))} 

2. Consider Kolmogorov relativizations K"^, K^^^ and enumerations 

and ('0m)mGN o.'iT'd of Miupp, PR^ and A-r.e. sets as in Point 2 

of Lemma \8.6[ 

Point 1 relativizes uniformly, i.e., the above total recursive functions 6q,9i : 
^ N can be taken so as to satisfy all possible relativized conditions. I.e., 
if are total, monotone and tend to +oo then 

Wj is infinite ^ ^eo(ii) ^ ^ is an infinite subset of 
Wfr^{x:K^^^{x)<<t^f{K^{x))} 



N \ is infinite and ip^ > growth^\y^rA 

9\ (i,k,m) 



3-'*i fS'^''^ An"'"*) 

Wn (■ u ) ^ is an infinite subset of 



(N \ W^) n {x : K^iJx) < 0^(K^(x))} 

Proof. 1. The strategy. The proof follows that of Lemma [8.61 except that 
now is equal to mina^ and that ai and ai also depend on the index m 
of the recursive majorant ■0^ of the growth function of the set. 
Since ao (resp. ai) has to be in Miripp, i.e. is to be recursively approx- 
imated from above, we have to force that, for given i,j,k,m,p, the first 
defined ao{i,j,p,t) (resp. ai{i, k,m,p,t)) majorizes an element x of Wj 
(resp. N \ Wk) which is such that Kjj^^^ix) < (j)i{K{x)). 
To insure this, we choose ao(i,j, p,0) (resp. ai(i, /c, m, p, 0)) so that the 
interval [0, ae(i, j, p, 0)[ (resp. [0, ae(i. A;, m, p, 0)[) contains at least 2^1?!"'"^ 
points in {x : K^^^{x) < (t>i{K{x))}. 

2. We shall use the partial recursive approximation from above (p^(^i){x,t) of 
(j)i{x) defined in point 2 of the proof of Lemma [ 

3. Functions Of and a^. 
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Let Zo(z, J, p) be the set of 2^1^!^"'^ distinct elements which appear first in the 
standard enumeration of Wi. We define as fohows: 



ao(«,J,P,0) 



ao(«,j,P,t + 1) 



the largest element of Zo(i,j, p) 

ao{i,j,P,t) if v?^(j)(/s:*(ao(i, j,p,t)),t) > 2 IpI 

X ^^{i){K^{ao{hj,P,t)),t) <2|p| 

and X is the largest element of 
Zo{i,j,p) n [0,ao{i,j,p,t)[ 

undefined if (^^(j)(ivr*(ao(i,j, p, t)), i) is undefined 



We now define ai, using the recursive majorant 'tpn 



aiii,k,m,p,0) = V'm(2'IPl+') 

Let u = ip^(^i-){K\ai{i,k,m,p,t)),t) 



ai{i, k, m, p, t) 



ai{i, k, m,p,t + 1) 



if u > 2 IpI 

and ai {i, k, m, p, t) ^ Wk,t 



ai{i, k,m,p,t) — 1 if u < 2 |p| or (u > 2 |p| 

and ai{i, k,m,Tp,t) € Wk,t) 

if u is undefined 



undefined 
Clearly, and ai are partial recursive. 

Claim. Suppose (j)i G Minpj^ is total monotone increasing and tends to 

+ 00. 

a. If Wj is infinite then (p,t) i— > ao{i,j,p,t) and p ao{i,j,p) are total 
functions and 

Vp (ao(i,j,p) G Wj A (l)i{K{ao{i,j,p))) > 2|p|) 

b. Function ai is total, N \ Wk is infinite and ipm is a total recursive 
function such that tpm ^ 9fowth^\y/^ then p ^ ai{i,k,m,p) is a total 
function and 

Vp (ai(i, /c,m,p) ^ Wfc A (pi{K{ai{i,k,m,p))) > 2\p\) 
Proof of Claim. 

As seen in the proof of Lemma [8 .61 if (pi is total then so are ^p^(i) and ao, oi. 
Also, for any fixed p, for all large enough x and all t, we have 

> MK\x)) > MK{x)) > 2|p| 

Suppose Wj is infinite. Then Zo{i,j,p) contains exactly 2^IpI+^ elements. 
Let i^jjjjjj = Ku where U G Min^p^^ Since there are 2^IpI+^ — 1 words 
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with length < 2 |p|, there is necessarily some element of x G Zo(i,j,p) which 
is not in U{{q : [q| < 2 |p|}), hence is such that K^^^{x) = Ku{x) > 2 [p|. 
Let xo{i,j,p) be the largest such element. It is easy to see that, for all t 
large enough, we have ao(i,j,p,i) = xo{i,j,p). Thus, ao(i, j,p) = xo(i,j,p) 
is defined and ao{i,j,p) G Wj D {4)i{K{x)) > 2 |p|}. Which proves Point a 
of the Claim. 

Suppose N \ Wk is infinite and ipm is a total recursive function such that 
V'm ^ g'l'owthfq^iY^. Then there are 2^1^!"'"^ elements of N \ which are 
< ^l^m{2'^^^^^^)■ As above, there is necessarily some such element x which is 
not in f/({q : |q| < 2 ip|}), hence is such that K^^^{x) = Ku{x) > 2 |p|. 
Let xi{i,k,m,Tp) be the largest such element. It is easy to see that, for all t 
large enough (namely, for t such that W^ri [0,xi(i, /c,m,p)[C Wk^t)^ we have 
ai{i,j, m, p, t) = xi{i,j, m, p). Thus, ai{i, k, m, p) = xi{i, k, m, p) is defined 
and ai{i,k,m,Tp) e (N\ Wfc) n {(j)i{K{x)) > 2 |p|}. Which proves Point b of 
the Claim. □ (Claim) 

We conclude the proof of the Lemma as that of Lemma 18.61 with analogous 
points 4,5,6 : the sole modification is to replace everywhere i^max by K^^^ 
and the max operator by the min one. □ 

8.4 Comparing K^:^^ and i^max ^ Barzdins 
We shall need the following result from [5J (Thm 7.15). 
Proposition 8.9. K <ct 2i^^^j^ + K^^^. 
Using Prop l8T9l Lemmas 18.61 18.81 yield the following corollary. 
Lemma 8.10. _ 

1. Let's denote the family of infinite 11^ subsets of N with recursively 
bounded growth. 

Suppose (/) : N — > N is a total function in Miup^ which is monotone and 
tends to +oo. Then 

i. {x : K^^^{x) < HK^^Jx))} is constructively (SOuH?, 3^'?^(S0An0))- 
dense. 



II. 



■ ^mm(^) < HKm^Am constructively (S?un?, 3^^(S?An?))- 
dense 



Moreover, this result is uniform in (p and, for ii, in a recursive bound for 
the Hi set, in the sense detailed in Lemmas \ 8. 6^8. 8[ 

2. Consider Kolmogorov relativizations K"^, K^^^, K^^^ and enumerations 
{(pf)i^j>ii and {ilj^)me'M and (IVj^)jeN of Miripj^, PR^ and A-r.e. sets as in 



Point 2 of Lemmas E 
Then Point 1 relativizes uniformly in the sense detailed in Lemmas \8.6'[i8.8[ 
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Proof. Let (f) G Miupj^ be total, monotone increasing and unbounded. Set 

X X — c 

9{x) = min{-,(?!)(max(0, J))} 

Then 9 is also a total, monotone increasing and unbounded function in 
Miup^. Also, one can recursively go from a code for (p to one for 6. Using 
Lemmas 18.61 18.8^ it suffices to prove that, for all x, 

^min(^) < GiK{x)) i^min(^) < </'(^max(^)) 

^max(a;) < G{K{x)) K^^^{x) < <l){K^^^^{x)) 

We prove the first implication, the second one being similar. 
Applying Prop l8.9| let c be such that, for all x, 

K{x) < 2 Kjnm(^) + ^max(a;) + C 
Suppose i^jnm(^) < ^(^(^))- Then K^i^{x) < I K{x), so that 

K{x) < 2K^^{x)+K^^^{x)+c < ^^ + K^^^{x)+c 
and K{x) < 2 {K^^g^^{x) + c). 

Therefore, K^^{x) < e{K{x)) < 9(2 {K^,^{x) + c)) < <I^{K^M)- □ 
8.5 Syntactical complexity 

Whereas {x : K{x) < (f){x)} is r.e. whenever (p is partial recursive (cf. 
Lemma 18. ip , the complexity of the sets considered in Lemmas 18.61 18.81 18.101 
to compare K, -f^max > -^min much higher and does involve bounded quan- 
tifications over boolean combinations of Sj* sets as is the case in the density 
results obtained in these lemmas. 

Proposition 8.11. Let cf) be a total function in Miup^. The sets 

{x ■■ i^max(a;) < (k{K{x))} {x : K„,^^{x) < (p{K^in{x))} 
{x : K^^{x) < HKix))} {x : K^Jx) < <PiK^,Jx))} 

are all definable by formulas of the form 

3<iog v<iog ^AABAC) 

where A,B,C are S^VH]'. In particular, theses sets are (cf. Prop \2.11\) . 

Proof. Without loss of generality, we can suppose that K^g^^{x) and K^[^{x) 
are both < log(x) for all x. Let [/ : N ^ N and F, H^, : ^ N be partial 
recursive functions such that K = Ku and K^^^ = Ka and -f^max ~ ^'^'^ 
4){x) = mint where a{x) = min^ V{x., t) and j3{x) = min^ VF(x, t). 

Following a usual convention, we shall write 3p'Pl-^... and Vp'^l-^... in place 
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of 3p (IpI < X a ...) and Vp (|p| < x =^ ...). 
Then -fiTmaxl^) < 'Pi^i^)) if only if 

3p-l^|pi|<log(3;) 3p2lP2|<log(a;) yq_|^|qi|<|pi| \/q2lq2|<|p2| 

[C/(pi) = X A f/(qi) / X 

A 3t y(p2,t) = X A yt (y(p2,t) is undefined or < x) 

A (Vt (T/(q2,t) is undefined or / x) V 3t V{q2,t) > x) 

A Vt (99(|pij,t) is undefined or |p2l < i^(|pi|,t))] 

Whicli is a formula of the form stated in the Proposition. All three other 
cases are similar. □ 

Bounded quantifications over boolean combinations of sets are also 
involved for the set of integers with K, Kjj^g^^, K^^^ incompressible binary 
representations. 

Proposition 8.12. The set 

I={x: ram{K{x),K^^^{x),K^-^{x)) > [log{x)\ - 1} 
is infinite and is definable by a formula of the form 

V^'°s {A A B) 
where A,B are V n^. In particular, this set is 

Proof. Without loss of generality we shall suppose that K < i^max 
K < -f^jjjjjj- The usual argument to get incompressible integers works: there 
are X]i<n 2* = 2" — 1 programs p with length < n, hence at most 2 (2" — 1) 
integers x such that -fi'max(^) < ''^ or -f^jnin(^) ^ Thus, for every n, there 
exists an integer x < 2"+-'^ — 1 such that -?^niax(^)5 -^mm(^) — Observe 
that such an x is necessarily in / since log(a;) < log(2"+i - 1) < n + 1. 
Which shows that / is infinite. 

We let V, W be as in the proof of Prop ISTTl Then x (z I can be written 
Vp|p|<Liog(a;)J-i ^(y^ (^v{p,t) is Undefined or 7^ x) V 3t V{p,t) > x) 

A (Vt {W(j),t) is undefined or / x) V 3t W{p,t) < x)] 

Which is a formula of the form stated in the Proposition. All three other 
cases are similar. □ 

Remark 8.13. In case (f> is small enough (say (j){z) < z — 1), the set I is 
obviously disjoint from all fours sets considered in Prop lSTTTl 
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8.6 The hierarchy theorem 

We can now prove the central application of the OftLesS| relation and 
the <C and orderings. Namely, a strong hierarchy theorem for 

K, K^-^g^^, K^^^ and their oracular versions using the successive jumps ora- 
cles. 

Whereas Thm JHTHl involves the sole <ct ordering, the refinment obtained in 
ThmEm below involves a chain of more and more complex orderings which 
all refine <ct and are relevant of Thm l4.6l and Cor l4.7i 

Theorem 8.14 (The hierarchy theorem). Let he the subclass of 

subsets o/N consisting of sets definable by formulas of the form 3-^(S^An^) 

where : N — > N is a total function which is recursive in 

the set o/n^ sets with i/}^'^^ -recursively bounded growth (cf. Def \8. 7\ ). 

Then 

1 loe »''°'''° K K »''^'''" K^' 

L. log ^pj^ ±V ^Minpj^t -"^max ^pR0' ■•• 

Z. log ^pf^ ^Minpj^T min ^PR0' ^ ••• 

- ^>pR0(-i) ^ »Mmp^^(„_i)T ^min >>pR0(n) ^ - 

3. There is a constant c such that all >ct inequalities in 1 and 2 (which are 
inherent to the ^ and S>| orderings) are > inequalities up to c. 

4. Though i^max '^''^^ ^min '^^^ — ct incomparable, we have 



KtV' OftLessfr.^"-^" . K'. 



^max *^«"^^0(n-i) T min 

K®'""'' OftLess^"^"" ' i^^'""" 

Proof. 1. <ct inequalities. Inequality log >ct K is well-known. The inclu- 
sions (cf. Prop l2.l5]) 

yield inequalities 

2. Inequalities ... » K*^*'' . Lemma ET] with A = f/> and o log in place of 
(p yields inequality log ^p^ ^ K. 

Since -R'max is recursive in A' (cf. Thm ]6.4]) . Lemma l8.ll with A = 0('^~^) 

and if o K^ax'' in place of if yields inequality K^ax'^ ^p^^nf"^' 
Idem with K^^^. 



^0(") > ^0(") > ^0("+i) ^0(") > ^0W > ^0("+i)^ 
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3. Inequalities ' ^ .... Direct application of Lemmas [8^ 18.81 

4- Point 3 of the theorem. This is the benefit of the uniform oracular prop- 
erty obtained in Lemmas EH ESI EH IHlnl 

5. Finally, the OftLess relations (Point 4 of the theorem) are direct appli- 
cation of Lemma 18.101 □ 

Remark 8.15. The scattered character of comparisons with respect to the 
<C orderings is unavoidable since all complexities K, -RTmaxi -^min' •"' K'^^"^ 
are equal up to a constant on the infinite set of integers with X^'"' incom- 
pressible binary representations. 
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